Method 1 - Babbitt Score 



(1100) For a given variable, for all 
observations, convert provided values 
into proxy values, if necessary. 




r 


(1200) For a given variable, for all 
observations, segregate proxy values 

associated with the variable into 
categories (e.g., Top 2 box, Top 3 box, 
etc.) 




r 


(1300) For each category, determine 
values' distribution by dividing number 
of provided values in category by total 
number of provided values 






(1400) Calculate a top category score 
by adding the top category distribution 
(%) to the bottom category distribution 
{%) and subtracting an ideal 
distribution of neutrals (%) and 
multiplying an absolute value of the 
result by 100 




r 


(1500) Calculate a difference score by 
subtracting the bottom category 

distribution (%) from the top category 
distribution (%) and multiplying an 
absolute value of the result by 100 




r 


(1600) Calculate an effectiveness 
(Babbitt) score for the variable by 
adding the top category score to the 
difference score 




r 



(1700) Evaluate the variable based on 
the effectiveness score 



Method 2 - Bestfit Clustering 



(2100) For each observation, obtain dataset, 
each dataset having observation IDs, variables, 
possible values, provided values, and (where 
applicable) proxy values for provided values 



(2200) Specify a number of clusters, 
any desired variable weights, and a 
maximum number of iterations for the 
clustering solution 



The # of clusters is an integer > 0. 
The # of iterations is an integer > 0. 



(2300) Develop initial cluster 
assignments: Select only 1 path within 
(2130) 



(2350)'f|ead specified initial cluster 
assignments (already present in 
fcgtaset, cf. Method 3) 



Throughout Method 2, variable 
weights (where applicable) are 
incorporated within fitness score 
calculation (cf. Method 10) 



i 



(2360) Systematic Search: Identify 
the pair of variables that creates a 
clustering solution that maximizes 
fitness score using the specified 
number of clusters 



(2370) Thorough Search: identify any 
two variables that together create a 
clustering solution that maximizes 
fitness score using the specified 
number of clusters 



(2361) Discover the 1 variable that 
creates a clustering solution that 
maximizes fitness score using the 
specified # of clusters 



(2371) Discover the 1 variable that 
creates a clustering solution that 
maximizes fitness score using the 
specified # of clusters 



(2362) Hold the variable from (2361 ) 
constant and discover the variable that 
in tandem creates a clustering solution 
that maximizes fitness score using the 
specified # of clusters 



(2372) Hold variable from (2371) or 
(2373) constant and discover the 
variable that in tandem creates a 
clustering solution that maximizes 

fitness score using the specified # of 
clusters 



(2373) Hold variable from (2372) 
constant and find the variable that in 
tandem creates a clustering solution 
that maximizes fitness score 



(2400) Store observation IDs, corresponding 
cluster IDs, fitness score 




Repeat mis process by 

cycling through all 
possible combinations 
of variable pairings until 

fitness score as 
calculated in (2373) is 
maximized 
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Method 2 - Bestfit Clustering - Continued 



i. 2a 



FROM (2400) 



(2450) For each cluster and variable, 
calculate the mode of provided values, 
and (where applicable) proxy values 
for provided values 



(2460) Store cluster IDs, variable IDs, 
and corresponding modes from (2450) 



r 



From (2591) 



(2470) Select a fraction of 
observations, divided evenly among all 
specified clusters from the dataset 



(2480) Randomly re-assign the 
observations from (2470) to different 
clusters 



it is preferrable that 
observations be chosen 
randomly; furthermore it is 
preferrable that the exact 
fraction never exceed 10% of 
the entire dataset's population 
of observations 




(2490) For each cluster and variable, 

calculate the mode of provided 
values, and (where applicable) proxy 
values for provided values 



(2500) Calculate fitness score for the 
clustering solution developed in (2480) 



(2505) Store fitness score, cluster 
assignments, and observation IDs 



From (2550) 



(2510) Select one random observation 
from a random cluster and change its 
cluster assignment 



(2520) Calculate fitness score of 
(2510) 



(2530) Conditional function: Compare 
fitness score of (2520) with (2505) 



Only proceed if looping 
from (2550) 



(2531) If fitness score of (2520) 
< or = fitness score of (2505), 
cycle through all possible cluster assignments 
for observation selected in (2510) until fitness 
is maximized 



(2536) If fitness 
score of (2520) 
> (2505), proceed 
to (2540) 



(2532) Conditional function: Compare 
maximum fitness score of (2531 ) with (2505) 



(2533) If fitness score of (2520) 
< or = (2505), return selected 
observation to original cluster 
assignment 



(2535) If fitness 
score of (2520) 
> (2505), proceed 
to (2540) 



(2534) Return to 
(2510) 



(2540) Store 
Observation IDs 
and new cluster 

assignments 



(2550) Replace 
(2505) with (2540) 
and return to (2510) 



Hold the other observations in 
their current duster 
assignments from (2505) 



(2551) If fitness score of 
(2520) = (2505), 
proceed to (2560) 



(2552) If fitness score of 
(2520) < or > (2505), 
return to (2540) 
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Method 2 - Bestfit Clustering - Continued 




FROM (2551) 



To (2470) 



(2560) End iteration 



Steps (2510) 
through (2560) 
represent 1 Iteration j 



(2570) Store Iteration ID, 
Observation IDs, corresponding 
cluster assignments 



Iteration ID is a positive integer <= the 
total # of specified iterations. Its value 

increases serially in the form 
x + 1 where x = previous iteration ID. 



(2580) Conditional function: 
compare Iteration ID from 
(2570) with total # of iterations 
specified in (2200) 



(2581) If Iteration 
ID from (2580) < 
total # of iterations 
specified in (2200), 
return to (2470) 



(2582) If iteration 
ID from (2580) = 
total # of iterations 
specified in (2200), 
proceed to (2600) 



(2600) Store Iteration ID that produced maximum 
fitness score, maximum fitness score, observation 
IDs, and corresponding cluster assignments that 
produced maximum fitness score 



(2610) Dump data from (2600) 
into a file of usable format (e.g. 
ASCII, .csv, .txt, .prn) 



(2620) Terminate 



Fig. 2c 



Method 3 - Champion/Challenger 
Clustering Refinement 



(3010) For each observation, obtain dataset, 
dataset having variables, possible values, 
provided values, and (where applicable) 
proxy values for provided values 




r 


(3020) Append initial cluster assignments 
to dataset (so they correspond to 
Observation IDs) 




r 


(3030) Specify maximum number of 
iterations 




f 


(3040) Execute (2450) to (2610) of 
Method 2 






(3050) Terminate 
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Method 4 - Composition Analysis 



(4010) For each observation, obtain dataset 
having a cluster assignment for the 
observation and having a proxy value for 
each of the variables in the dataset, each 
variable having possible values 



(4020) For each observation, estimate a 
purposeful probability (a measure of a 
proability that an observation in a particular 
cluster provides an answer to a question in 
a non-random manner) that a particular 
possible value for a particular variable will 
be provided by observations assigned to a 
particular cluster 



(4021) Create probability variables 
for each cluster, variable, answer 
combinations as p(kg\ 



(4022) Estimate the probability that answer 
valued is given by the observations in 
cluster m for a variable k that has L k 
possible answers 



(4023) Define § within a constraint that 
allows for usable output 



(4025) For each observation, 
store and/or output the 
purposeful probability 



(4024) Computational process is executed 
across all 

_ Nm{kj) 



Pm(k,i) = - 



Nm 



f -(l-S*Lk)+S 



\fS = 0, the resulting ; 

over-precision of the 
calculated probabilities 

compromises 
computational efficiency 



5 - min {0.02, 



2L 

is a value that produces 
meaningful results 



(4030) For each observation and 
each possible value, calculate a 
serendipity probability (a measure 
of a probability that an observation 
in a particular cluster will be 
associated with any of the 
possible values for a particular 
variable) 



(4050) For each observation, assume that 
before observation made, observation has 
an equal probability of being in any cluster 



(4055) For each observation, assume that 
the purposeful probabilities are true 



/ 



Let N m = total # of observations in 
duster m; NJk, £) = the # of 
observations in cluster m who give the 
&th answer value to variable k; and 



S = min { 0.02 , 



2L 



If observation i in cluster m 
"purposefully" and "logically" 
selected his responses, then the 

probabilities of selecting his 
responses should be described by 



Pm{k,l) 



If a ojp5ervation / in cluster m 
defected responses 
"randomly," then the 

probabilities of selecting his 
responses should be 
described as 



(4060) For each observation calculate a Bayes 
probability that a particular observation can be 
in each cluster conditional upon the 
observation's proxy value 



(4065) For each 
observation, store and/or 
output the Bayes probability 



(4035) For each observation, 
calculate a ratio of purposeful 
probability to serendipity probability 



(4040) For each observation, calculate a log of 
the ratio to obtain a composition analysis score 



(4045) For each observation, store and/or 
output the composition analysis score 



Calculate 

NB: n means calculated for each 
{h„.,K} where k - 1\ 

£ retains its 
customary function 



(4080) For each observation, calculate a 
percent of proxy values for the variables 
that equals a mode of that observation's 
cluster's proxy values for the 
corresponding variables 



(4085) For each 
observation, output 
the calculated 
percent 



(4090) Classify each observation based on results obtained in 
activity (4045), (4065), and/or (4085) 
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Method 5 - Segmentation-on-the-Fly 



(5100) Obtain dataset for observations, 
dataset having variables, possible 

values, provided values, and 
corresponding cluster assignments 



i For this flow chart, let the total set I 
j of variables be defined as {K} and j 
the desired maximum # of 



variables to be used as k 



'maxCe) 



(5200) Conditional function: Determine if 
cluster weights are needed to meet 
coverage or efficiency objectives 



Underweighting is used to implement 
efficiency, while overweighting is used to 
implement coverage 



(5210) If no weights are 
needed, proceed to (5300) 



(5220) Conditional function: 
Assign each cluster a weight 
using the decision rules in 
(5221), (5222), (5223) 



All clusters must be 
assigned weights, 
regardless of magnitude 



(5221) If cluster is to be 
unweighted, set weight 
as w = 1 



(5222) If cluster is to be 
overweighted, set weight 
as w > 1 



(5223) If cluster is to be 
underweighted, set 
weight as 0 < w < 1 



(5300) Begin approximating the clustering solution 
developed using Method 2 by developing clustering 
solutions that employ only 1 variable 
from {K} in each. 



(5310) Create a "dummy" variable for each 
cluster so that if there are M clusters, then 
M variables 



(5320) Conditional function: populate M variables 
per observation per clustering solution 



jln other words, if there are K variables, then K 
"j optimized solutions are created, 1 per k in {K}_ 



Let Y m designate a 
"dummy" variable for 
observation / in cluster m 



Let i be a member of the set of 
observations {R}, £ be a member of 
the set of variables {K}> and m be a 

member of a set of clusters {M} 



(5321) If observation / is in 
cluster m, then Y m - 1 



♦ 

(5322) If observation i is 
not in cluster m t then Y = 0 





r 




(5330) Store all values for M 
variables for all observations 
for each clustering solution 
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Method 5 - Segmentation-on-the-Fly - Continued 




(5340) Create a "dummy" variable for every 
variable-possible value combination so that 
if there are L k possible answers to variable 
k, then L k "dummy" variables are created 
for each observation i for each clustering 
solution 



So the total number of variables 
created per observation per 
cluster is ^fL^ 



(5350) Conditional function: for observation i 
and variable K populate L k variables per 
clustering solution 



(5351) If observation / 
gives the ^-th answer for 
variable k, then X f = 1 



(5352) If observation / 
does not give the £ -th 
answer for variable k, 



Let Xi$k designate a 
"dummy" variable for 
observation i who can 
answer possible value I or 
variable k 



(5360) Store all values for K(h) variables 
for all observations per clustering solution 



(5370) For each cluster in {M}, use ordinary 

least squares to regress all Y m for all 
observations in {Rj per clustering solution 



■ Index is created by 
multiplying the linear 
approximation to the 

probability of an 
observation's cluster 
assignment by that 
cluster's specified weight 



Regression occurs on: 



k\x m -k S K,l<t<L k -l}} 



so that we can generate a linear approximation to the 
probability that an observation with a particular set of 
answers to the variables in (K) Is in a particular cluster 
within {M} 



(5380) Conditional function: construct a "simpler" 
clustering solution to the one generated using 
Method 2 (Bestfit clustering) 



(5381) If weights were specified 
in (5200), create an index for 
each observation's cluster 
association 



j By "simpler", what is meant is an 
| approximation of the "actual" 
^ clustering solution using foe 
[ specified constraints, in this case 
\ using only 1 variable within {K} 



(5382) If weights were not specified in (5200), assign 
each observation in {Rj to the m-th cluster in {M} that 
gives the highest value of the linear approximation to 
the probabilities of being in any of the members of {Mj 
as calculated in (5370) for each clustering solution 



(5383) Assign each observation in {Rj to the 
m-th cluster in {MJ that gives the highest 
index value for each clustering solution 



(5390) Store the outputs of regression (i.e. coefficients and 
constants), variable IDs, observation IDs, "approximated" cluster 
assignments, and actual cluster assignments for all clustering 
solutions 
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Method 5 - Segmentation-on-the-Fly - Continued 




FROM (5390) 



(5400) Calculate accuracy 
scores for the results 
stored in (5390) for ali 
clustering solutions 



Accuracy score = 
[# of observations whose 
approximated and actual 
duster assignments are 
identical] divided by [the total 
# of observations in {R} ] 



(5410) Select the stored 
solution from (5390) that 
maximizes accuracy score 



(5411) Store the outputs of regression (i.e. coefficients and constants), 
variable IDs, observation IDs, "approximated" cluster assignments, and 
actual cluster assignments for the solution that was selected in (5410) 



(5420) Begin approximating clustering 
solutions using only 2 variables in each 



(5421) Hold variable k from 
(541 1) constant and now 
execute (5310) through (5400) 
for all possible pairs of k from 
(5411) and the 
{k + *\yth variable 



(5422) Refine winning 2 variable solution 
from (5421) 



; The pattern in 
! (5423) increases 
I serially as the 
I number of variables 
| used to approximate 
| the clustering 
j solution from 
j Method 2 increase 
! serially 



(5423) Hold the 
(k + 1)-//z variable from (5421) constant and now 
execute (5310) through (5411) for all possible pairs 

of the {k + 1 )-th variable from (5421 ) and the 
remaining variables in {K}, excluding the (k + 1)-th 
variable and variable k identified in (5411) 



(5430) Continue looping (5420) through (5423) by sequentially 
increasing the number of variables used in (5420) at the beginning of 
each loop until a maximized solution (in terms of accuracy score) is 
identified for a simpler clustering solution that uses k, } variables to 
approximate the clustering solution identified in Method 2 



(5440) Select and store the outputs of regression, variable IDs, "approximated" cluster 

assignments (and corresponding observation IDs), actual cluster assignments (and 
corresponding observation IDs), and accuracy scores for only the maximized solutions 
for all solutions created up through and including £ variables 



Therefore if the (k + 2)~th 
variable is added to the pair 
of the k-th and (k + l)~th 
variables to create a 
clustering solution that best 
approximates the objective 
function (i.e. original 
clustering structure 
developed in Method 2), then 
in the refining process 

(5422), the 
(k + 2)-th variable is held 
constant while the k-th and (k 

+ l)-th variables are 
replaced with all remaining 
variables to test the triplet of 

variables that best 
approximates the results of 
Method 2 



(5450) Dump (5440) into a file with usable data format 
(e.g. ASCII, .txt, .csv, .prn) 



(5460) Terminate 
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Method 6 - Behavioral Segment Scoring 



(61 00) For each observation, obtain j Dataset ^ consist of 

dataset, each dataset having variables, j any eom binatron of 

possible values, provided values, and -j gca[ar . ^^0^ and 

corresponding cluster assignments \ contimjous variables 
(developed in Method 2) 



"Anal^e dkiribution boundaries within a 
series of ranges to find the boundaries that 
create as normal distributions as possible; 
linear optimization is the most efficient 
method for execut]ng this 

i 

(6300) Conditional function: Refine 
dataset to facilitate analysis 



(6200) Transform all continuous variables 
into categorical or scalar forms 



(6310) If dataset 

has <= 100 
variables, proceed 
to (6400) 



T 

(6320) If dataset 

has > 100 
variables, reduce 
dataset as much 
as possible 



(6321) Execute the following 
analyses: 

- log scores 

- tree analysis 

- regression 

- discriminant analysis 



(6322) Remove variables 
identified in any 3 of 4 of the 
techniques in (6321) as "non- 

contributors'Tinsignificant" 



These are standard 
statistical techniques that 
can be done in a 
mathematical 
programming language 

like Fortran or stat 
software package like 
SPSS orSAS 



Although <= 100 variables 

is ideal (in terms of 
computational efficiency), 
do not force an arbitrary 
"cut-off 1 to ensure < =100 
variables are used in 
the dataset 
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Method 6 - Behavioral Segment Scoring - Continued 



FROM (6310) or (6322) 



(6400) Conditional function: Specify 
maximum # of behavioral variables to be 
used in solution set depending on 
computational and/or time constraints 



(6410) If there is a 
computational or time 
constraint, select a 
maximum # of behavioral 
variables to be used < 
total # of behavioral 
variables in the dataset 



(6420) if there is no 
computational or time 
constraint, make 
maximum # of behavioral 
variables to be used = 
total # of behavioral 
variables in the dataset 



1 




(6500) Conditional fi 
cluster weights ar 
marketing cover; 
efficiency 


jnction: Determine if 
e needed to meet 
age or marketing 
objectives 



(6510) if no weights are 
needed, proceed to (6600) 



(6520) Conditional function: 
Assign each cluster a weight 
using the decision rules in 
(6520), (6522), (6523) 



(6521) If cluster is to be 
unweighted, set weight 
as w = 1 



All clusters must be 
assigned weights, 
regardless of magnitude 



(6522) If cluster is to be 
overweighted, set weight 
as w> 1 



(6523) If cluster is to be 
underweighted, set 
weight as 0 < w < 1 



(6600) Execute steps 

(5300) to 
(5450) (of Method 5) 



(6700) Terminate 
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Method 7 - Panel Analysis 



Th\i% needed to ensure 
that ffce clustering solution 
developed using this 

Udataset is truly 
; representative of a 
mafteet/ihdustry and just 

tale function of an 
idiosyncratic group of the 
bjerail population 



Analyze distribution 
\ boundaries within a series of j 
ranges to find the 
boundaries that create as 

normal distributions as 
possible; linear optimization 
is the most efficient method 
lor execut[ng_th]s_ 



(7100) Conditional function: Ascertain 
use of panel data 



(7110) if use panel data as 
objective measures of 
behaviors to input into 
clustering executed using 
Method 2, follow this path 



1 


r 


(7111) Refine data 
collection instrument (e.g. 
survey) using Invention ! 

(i.e. Babbitt Score) 




r 


(7112) Field data collection 
instrument within panel (e.g. 
IRI, Nielsen, Simmons, 
comSCORE, MR!) 




r 



(7113) Extract observations 
from collected data to 
assemble a dataset that 
reflects a category's/ 
industry's underlying 
demographics 



(7114) Obtain dataset for 
extracted observations, 
dataset having variables, 
possible values, and 
provided values 



(7115) Append panel-based 
behavioral variables to each 
corresponding observation 
in dataset 



(7116) Transform any panet 
variables that are 

continuous into categorical 
or scalar variables 



(7117) Input data set from 
(7116) into (2420) of BestFit 
Clustering and proceed with 
clustering 



(7120) If use panet data for 
post-clustering analyses 
(e.g. tracking, promotion, 

positioning) follow this path 



These 2 paths are not 
exclusive, but cannot be 
executed simultaneously. 
However, path (7110) can 

feed into path (7121). 



(7121) Conditional function: 
Data collection 



(7121.1) If dataset 
developed using 
path (7110), proceed 
to (7122.1) 



(7121.2) Refine data 
collection instrument (e.g. 
survey) using Babbitt Score 



(7122) Execute 
Methods 2 
through 4 



(7123) Execute 
Methods 2 
through 5 



(7123.1) Use typing tool developed in (7123) 
to cluster score a representative sample of the 
panel's members using an expedient contact 
channel (e.g. outbound telephone, e-mail/ 
electronic surveys, mail-based surveys 



(7124) Execute cluster-level 
analyses using panel data 



(7125) Terminate 



(71 18) Terminate 
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Method 8 - Overall Segment-Based Marketing Process 



(8100) Develop and Field 
Pilot Survey 



(8200) Refine Survey 



Babbitt Score 
Bestfit Clustering 



(8300) Field Full 
Enumeration Survey 



Append panel variables and/or other 
respondent-lvel behaviours (if applicable) 



If applicable 



(8850) Panel Analysis 



(8400) Clean Data 




r 


(8500) Create Clusters 




r 


(8600) Refi 


ne Clusters 



(8800) Append Panel 
Variables 



Composition Analysis 



Babbitt Score 

Champion/Challenger Cluster Refinement 
Panel Analysis 



Composition Analysis 



(8700) Segment-on-the-Fly 



(8750) Behavioral Segment 
Scoring 



(8900) Develop Segment 
Insights 



(8950) Develop and Execute 




Marketing Ideas 


« 
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Information Device 9 



1 — * 


(9500) I/O 








(9400) Instructions 


— ► 


(9300) Memory 






— ► 


(9200) Processor 






-> 


(9100) Network 
Interface 



Method 10 - Fitness Score Calculation 



(10010) Calculate modes of given values for all 
variables in {K} for cluster n 

' + ~~ 



(10020) Store modes, corresponding 
variable IDs, corresponding cluster ID 



Where ne{N}e{l} 

N consists of a finite # of clusters > 0. 
/ = domain of integers 



(10030) Calculate modes of given values for ail variables 
in {KJfor cluster n+y 



(10040) Store modes, corresponding 
variable IDs, corresponding cluster ID 



T 



(10050) Conditional function: Assess 
the number of clusters for which 
modes have been calculated 



(10060) If the number of 
clusters for which modes 
have been calculated = N, 
proceed to (10080) 



(10070) If the number of 
clusters for which modes 
have been calculated < N, 
return to (10030) 



Where ke{K}e{l] 

K consists of a finite # of 

variables >0. 
I- domain of integers 



(10080) For each cluster, compare the 
value provided by each constituent 
member for variable k to the cluster's 
mode for variable k 



Where ze{i?}e{/} 

R consists of the set of observations, 
whose total number of 

constituents is > 0. 
L=^Pmai0.o!jntegers 



(10090) Conditional function: compare 
value of i for k to the mode of k 



Where i is a member of cluster n 



k n is the variable k as answered by 
cluster n 



(10100) If equal, set 



(10110) If not equal, 
setK^O 



(10120) Store score V km 



Where V km = score for observation i 
who is in cluster n and has provided 
answer value Vior variable k 



(10130) Conditional function: adjust 
by indicated weight 



(10140) If weight was 
specfied, multiply V Ui 
by corresponding 
weight for k 




(10150) If weight was 
not specfied, multiply 











(10160) Store K^from (10140) or 
(10150) 



(10170) Repeat (10080) to (10160) until a 
score Kis calculated for all observations in 
their respective clusters for all variables k 



(10200) Sum all scores Kfor all 
observations across all variables 



This is the fitness score 



(10300) Store fitness score 



(10400) Terminate 
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